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What is an asset build system? 



C: \>Perforce2DiscImage.exe 
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WE DON’T NEED AN ASSET BUILD SYSTEM 

m 


A MODERN TALE OF HORROR 
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Why do I want a build system? 


GDCONF.COM 
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■ 


system? 


It does everything for you 
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Why do I want a build system? 


Everyone can run the entire process 
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Why do I want a build system? 



It knows about everything 


GDCONF.COM 




What are the parts of a build system? 
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What are the parts of a build system? 


List inputs 


Inputs 

WW 

/ \ 

Process 

v ) 



Outputs 
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What are the parts of a build system? 



Determine settings 
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What are the parts of a build system? 



Data conversion tools 
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What are the parts of a build system? 



Change detection 
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What are the parts of a build system? 



Failure handling 
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What are the parts of a build system? 

List inputs 
Determine settings 
Data conversion tool 
Change detection 
Failure handling 
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</what is an asset build system> 


GDCONF.COM 


The rest of this talk assumes you 
think this is the best idea ever 
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- intermission - 


This sounds awfully programmery, 
why should TA be involved? 
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How does a build system work? 


GDCONF.COM 


I'm sold on the idea, what do I need to 
know? 
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What makes it a build system ? 


GDCONF.COM 
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What makes it a build system ? 


GDCONF.COM 


a.k.a. Why a batch file isn't good 
enough 
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What makes it a build system ? 

It does dependency checking and change 
detection ------- 
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What makes it a build system ? 

It considers more than one asset at a time 
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What makes it a build system ? 

It does multiple levels of data conversion 
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What makes it a build system ? 

... it does dependency checking and 
change detection 

... it considers more than one asset at 
a time 

... it does multiple levels of data 
conversion 
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Do I have to make one from scratch? 


That feels like a lot of work... 
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Do I have to make one from scratch? 


NO NO NO 
NO NO NO 
NO NO NO 
NO NO NO 
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A selection of build tools 
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A selection of build tools 


Batch files 


Well, it'll work 


© 
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A selection of build tools 


make 


* so old 
there ' s no 
icon 


The granddaddy of all build systems 
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A selection of build tools 


msbuild 


xml based, command line processing 
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A selection of build tools 


ant 


xml based, extensible via java 
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A selection of build tools 


cmake 


custom language, generates native builds 
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A selection of build tools 


scons 


end to end python 
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How do we use these tools? 
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How do we use these tools? 


S PT 

sources —*■ processing — > targets 

? 

■ 
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SPT 


/ 

7 



Mesh 


mesnzgeo j * 

Geometry 
^ — 


/ 
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SPT 
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*> 


Geometry 





GAME DEVELOPERS CONFERENCE' 2014 


SPT 



MARCH 17-21, 2014 GDCONF.COM 


*> 


Geometry 


^ mtri2rtm 'y 




Runtime 

Material 
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SPT 



image 




r 


image2tex 
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Geometry 


^ mtri2rtm 'y 




Runtime 

Material 




Texture 
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SPT 
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SPT 





^ mesh2geo 




Geometry 



mesh2mtrP)- 



\ Tr 

Material 

Description 

s- 

] 1 ' 


c 

\ 

r 



mtrl2rtm 


>-T- 


Runtime 

Material 



image2tex 
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Build system SPT 


<psuedo_code> 
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Build system SPT 

Describe the processing for every 
type of file that you have 

for typeOfFile in ourGame: 


processor = Processor (typeOfFile . whatToDo) 
build. processors [typeOfFile] = processor 
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Build system SPT 


Tell it about instances of those files 


for sourceFile in ourGame: 

processor = build. processors [sourceFile . type] 
target = processor . add (sourceFile) 
targets += target 
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Build system SPT 

Tell it about the dependent files... 
repeat 


while ( len (targets) > 0 ) : 

for sourceFile in targets: 

processor = build . processors [ sourceFile . type ] 
newTargets += processor . add (sourceFile) 


targets = newTargets 
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Example 


</psuedo_code> 
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Example 


Brilliant game pitch... 

There's a ball rolling around a level, 
and you can't let it fall off 



GAME DEVELOPERS CONFERENCE' 2014 


MARCH 17-21, 2014 GDCQNF.COM 


Example 
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Example 

Asset Details: 

Multiple ball materials, one 
mesh 

Multiple Levels 

Levels have props on them 
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Example 
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Example 
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Example 
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Example 
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Example 



Ball mesh 


Ball materials 
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Example 



Ball mesh 


Ball geo 


Ball material 
list 


Level list 


Ball textures 


5 functions! 
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After a change 



Ball mesh 


Ball materials 


Levels 

: x: 


Prop list 

i 


Props 
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After a change 



Ball mesh 


Ball materials 


Levels 


Prop list 

i 


Props 
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After a change 


Ball mesh 


Ball materials 


Levels 

I 

Prop list 
Props 
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After a change 



Ball mesh 


Ball materials 


Levels 


Prop list 

i 


Props 
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After a change 



Ball mesh 


Ball materials 
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After a change 



Prop textures 
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After a change 



Ball mesh 


Ball materials 


Levels 


I 


Prop list 


Props 
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After a change 


Before 
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After a change 



Before 


Prop A. prop 
AwesomeProp_B . prop 
SortaOkProp_C . prop 
Crate . prop 



Props 
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After 

Prop A. prop 
AwesomeProp_B . prop 
SortaOkProp_C . prop 
Crate . prop 
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Example 



Ball mesh 


Ball materials 


Levels 

: x: 


Prop list 

i 


Props 
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Welcome to: 

Build systems 437 - Experience 

a.k.a. Reality 

a.k.a. Learn from my many mistakes 
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Experience 


This can be a big system 
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Experience 


This can be a big system 

Watch your scope 

Draw a dependency diagram 

Be prepared to spend some time with it 
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Experience 


Creating the dependency tree c 
take time 




GAME DEVELOPERS CONFERENCE* 2014 


MARCH 17-21, 2014 GDCONF.COM 


Experience 

Creating the dependency tree c 
take time 

Allow the user to select a subset 

Always have your build system do the entire 
thing 
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Experience 


GDCONF.COM 


Put your intermediate files into their 
own directory 
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Experience 


Put your intermediate files into their 
own directory 

/MyProject/BuildTemp/* ^ 
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Dependencies between files cause 
the most bugs 
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Dependencies between files cause 
the most bugs 

Missing dependencies - things don't rebuild 
when they should 

Extra dependencies - things build when they 
shouldn't 
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Experience 



Strike a balance between export time 
scripts and the build 
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Experience 


Later is less expensive 



Strike a balance between export time 


scripts and the build 

Earlier is better for feedback 
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Experience 


Be explicit with what you include in 
the build 


PARENTAL 


EXPLICIT CONTENT 
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Experience 


Be explicit with what you include in 
the build 

Avoid directory scans 


PARENTAL 


EXPLICIT CONTENT 
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</how does a build system work> 


GDCONF.COM 


Sources-Processing-Targets 
Dependency tracking 
Change detection 
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GDCONF.COM 


Who should run this thing? 
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- intermission - 


Who should run this thing? 

Everybody, all the time 
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- intermission - 


Who should run this thing? 

Isn’t this too complicated for artists to use? 
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9 Asset Build - Sphere Psychosis 

Characters 


g Ball.A 
g Ball_B 
g Ball_C 
g Ball_D 


Levels 


J Level 1 

* 

3 Level 2 

n 

3 Level 3 


3 Level 4 

E 

g Level 5 


g Level S 


g Level 7 



Platforms 


g PC 
P] Xbox One 

□ PS 4 
0 Android 

□ iOS 



Go 
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I «=» I I s I k^l 

Starting Sphere Psychosis Build 
Building for PC 

Reading ball material list 
Found 4 materials 

Reading Level list 
Found 8 levels 

Building texture Ball_B 

Generating prop list for Level 5 
Generating prop list for Level 7 
Found 28 props 

Building level geo Level 5 
Building prop Level 5_Start 
Building prop Level5_finish 

Error: Prop Level 5_Finish .prop is missing its collision geometry 
Building texture Level 5_Start Finish 

Done - Error 
Build time: 00:00:12 


Error: Prop Level5_Finish.prop is missing its collision geometry 

Pick hereto open Level5 Finish in PropEdit 
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- intermission - 


Who should run this thing? 

Your continuous build system should 
ALWAYS build everything. 
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How do I make one? 



SCons 


es-konz, skonz, skonz 
scons.org 
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SCons 


What do I need to know? 

The project root is important 
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SCons 


What do I need to know? 

Action = processing 
Builder = SPT encapsulation 
Environment = the build 
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SCons 


What do I need to know? 



SCons calls you back 

Dependency setup and processing are 
separate 
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SCons 
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Example 


<code> 
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Example 


Replace a batch file 

for %%F in (*.file) 
do 
( 

convert.exe %%~dpnxF % 


) 
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dpnF . output 
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Example 


With SCons 
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Example 


Create the build environment 

env = Environment ( ) 
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Example 

Create a builder 

env = Environment ( ) 

def my_action (target , source, env): 

convert ( source [ 0 ] .path, target [0] .path) 

env [ 'BUILDERS' ] [ 'my_build' ] = 

Builder (action = my action) 
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Example 


Tell SCons about the files 

env = Environment ( ) 

def my_action (target , source, env): 

convert ( source [ 0 ] .path, target [0] .path) 

env [ 'BUILDERS' ] [ 'my_build' ] = 

Builder (action = my_action) 

for src_fn in get_source_f iles ( ) : 
env. my build( source = src fn, 

target = get target fn (src fn) ) 
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Example 


Tell SCons about the files 


env = Environment ( ) 


def my_action(t 
convert (sou 


D 01 I® 


t [ 0 ] . path) 


env [ 'BUILDERS' ] [ 'my_build' ] = 

Builder (action = my_action) 

for src_fn in get_source_f iles ( ) : 
env. my build( source = src fn, 

target = get target fn (src fn) ) 
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Example 


Run it 

scons: Reading SConscript files ... 
scons: done reading SConscript files, 
scons: Building targets ... 
my_build ( [ "myf ilel . target" ] , [ "myf ilel . 

source" ] ) 

<spew removed for sanity> 

my_build ( [ "myf ile50000 . target" ] , 

[ "myf ile50000 . source" ] ) 
scons: done building targets. 

Exit code: 0 
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Example 


Run it again 

scons: Reading SConscript files ... 
scons: done reading SConscript files, 
scons: Building targets ... 
scons: done building targets. 

Exit code: 0 
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Dependent files 


psd — ► tga — ► texture 

for psd_fn in get_psd_f iles ( ) : 
tga_fn = as_tga (psd_fn) 
tex_fn = as_tex (tga fn) 
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Dependent files 


psd — ► tga — ► texture 

for psd_fn in get_psd_f iles ( ) : 
tga_fn = as_tga (psd_fn) 
tex_fn = as_tex (tga_fn) 

env . tga_to_texture (tex_fn, tga_fn) 
env.psd to tga (tga fn, tex fn) 
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Running an exe 


Use a generator builder 

def my_generator (target , source, env) : 

return "bin/convert . exe {0} {l}".format( 
source [ 0 ]. path, target [ 0 ]. path) 

env [ 'BUILDERS' ] [ 'my_build' ] = 

Builder (generator = my generator) 
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Sphere Psychosis SConscript 
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SCons - other fun stuff 
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SCons - other fun stuff 


Multicore support 

num_cpu = int (os . environ . get (' NUM_CPU ' , 2)) 
SetOption ( ' num jobs', num cpu) 
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SCons - other fun stuff 


Build cache 

Why build it if someone else already has? 

Cache Dir ( ' / / server /MyPro j ect /Bui ldCache' ) 

# opting out 

NoCache ( 'myf ile .file' ) 
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SCons - other fun stuff 


Incredibuild 


BuildConsole /command="python MyBuild.py" 
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*The rest of SCons 
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*check notes 
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</how do I make one> 
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Other interesting things you can to 
with a robust build system 
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brilliant idea 
loading... 
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Hook it into your asset reload system 
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Other interesting things you can to 
with a robust build system 
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Asset validation 
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Other interesting things you can to 
with a robust build system 


Asset DB generation 
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Other interesting things you can to 
with a robust build system 


Validate 


SpreadsheetName.scwbf 




»J | EURUSD 30 min # 


H 


J 


K 1 L | M N|Q[P|Q|R : SlT|U;V|W X | Y 


AA 


de 


Formula Source Sheet #1. Enter and r 
High Low Last Volume H of 
1.28704 1.286195 1.28632 8< 

1.28771 1.286195 1.286915 


1544 





1.29§*ri.289325 1.28969 

1.29116 1.289315 1.289355 
1.289625 1.288725 1.289615 
1.28953 1.288385 1.289305 
1.29011 1.28883 1.288955 

1.29011 1.288675 1.2901 

1.289785 1.288085 1.28869 

1.29055 1.28933 1.28979 

1.291295 1.28953 1.290145 

1.29133 1.287925 1.290775 
1.288815 1.287225 1.28822 

1.288915 1.2879 1.288805 

1.28953 1.287875 1.28873 

1.289835 1.288405 1.28928 

1.28886 1.287085 1.288575 
1.287765 1.28573 1.287355 

1.287015 1 .28621 1.28641 

h]\ Sheetl / 


2374 

4250 

2520 

3107 

3672 

2837 

4805 

5040 

7236 

9712 

6992 

3999 

5243 

5619 

4023 

3964 

2723 


odify formulas for this sheet on Sheetl 
Trades KLMNOPQRSTUVWXY 

801 
1544 
2610 


1.28613 


2374 

4250 

2520 

3107 

3672 

2837 

4805 

5040 

7236 

9712 

6992 

3999 

5243 

5619 

4023 

3964 

2723 


Bid Size: 1 

Ask: 1.28651 

Ask Size: 1 

Daily Oper 1.2874 
Daily High: 1.28807 

Daily Low: 1.28598 

Daily Net: 0 

Daily Volur 198 
Tick Size: 0.00005 


UlL 


ADX 

ADX 

21.14122963 
21.31723213 
21.50677109 
22.39836121 
22.1547184 
22.06072617 
21.54379845 
21.21553612 
20.8620224 
21.71703148 
22.72518539 
23.32631302 
23.9736824 
24.91906357 
24.59850121 
24.01695061 
23.39066505 
24.53086281 
24.9663887 
25.43541527 
25.31280136 
25.92634964 
77 60975766 


AC 


Moving Average-Simple 
Avg 

1.288839936 
1.289103389 
1.289421916 
1.289556026 
1.289548993 
1.289563417 
1.289641976 
1.289494991 
1.289439917 
1.289351463 
1.28934896 
1.289310932 
1.289036512 
1.288808584 
1.288515925 
1.288053513 
1.287587881 
1.287469506 
1.287342429 
1.287163973 
1.286937952 
1.286743522 
1 786506176 
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Other interesting things you can to 
with a robust build system 


Automated smoke and unit 
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Other interesting things you can to 
with a robust build system 


Tool install 
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with a robust build system 
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Code build 
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...and then lunch 
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Final thoughts 


It's 2014, 
system 


use some kind of build 
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Final thoughts 


Talk to your coders / build / deploy 
guys^see what they've got going on 
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Final thoughts 


If you're comfortable with Python, 
have a look at SCons 
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Final thoughts 


GDCONF.COM 


Start small, with a single system or 
process... 



GAME DEVELOPERS CONFERENCE' 2014 


MARCH 17-21, 2014 GDCQNF.COM 



Wmw^^ 

K 

lv 

Tw' 


ge amount 

vstem vA 


Final thoughts 
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Final thoughts 
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Do not allow assets to break the build, 
leave that to the coders 
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Thanks 
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